1 



Evaluation of pre-Service Training on Abraham HA et al 

ORIGINAL ARTICLE 



EVALUATION OF PRE-SERVICE TRAINING ON INTEGRATED MANAGEMENT 
OF NEONATAL AND CHILDHOOD ILLNESS IN ETHIOPIA 

Abraham Haileamlak (MD) 1 , Sirak Hailu (MD) 2 , Hailu Nida (MD) 3 , Teshome Desta (MD) 4 , 
Tesfaye Tesema (MD) 5 

ABSTRACT 

Background: The Integrated Management of Newborn and Childhood Illness strategy equips health workers with 
essential knowledge and skills to effectively manage sick children with common neonatal and childhood diseases. 
Since in-service training is very demanding to achieve the desired coverage of training of health workers, pre- 
service training is taken as a solution. At the time of the survey, most public and some private health professionals ' 
training institutions were conducting pre-service training. However, several concerns have been expressed on the 
training. Therefore, this survey was conducted to assess the status of pre-service Integrated Management of New- 
born and Childhood Illness training. 

Methods: A cross sectional survey on health professional training institutes/schools to evaluate pre-service Inte- 
grated Management of Newborn and Childhood Illness training was conducted in November 2007. Data was col- 
lected using pre-tested questionnaires, focused group interviews with teachers and students, observation of stu- 
dents while managing sick children using Integrated Management of Newborn and Childhood Illness guidelines, 
and reviews of pediatric course outlines and other teaching/learning materials. Data was entered in computer and 
analyzed using SPSS for Windows version 12. 0. 1. 

Results: Twenty nine health professionals ' training institutions (34 academic programs) which have started pre- 
service training were included in the survey. Of the 34 programs 22 were diploma nursing, 6 Bachelor of Sciences 
nursing, 4 health officer and the remaining two medicine. Thirty (88.2%) programs have integrated it in their cur- 
riculum. All academic programs had at least one fulltime staff for Integrated Management of Newborn and Child- 
hood Illness classroom instruction. Twenty nine (85.3%) programs had staff trained in case management skills. All 
the 34 academic programs taught health workers skills, 28(82.3%) used mixed approach. Integrated Management 
of Newborn and Childhood Illness was either incorporated for 21 (61.8%) or added to the previous teaching 11 
(32.3%). The instructor to student ratio was low for most of the schools. Main challenges encountered in the pre- 
service teaching were constraints with trained staff and other resources each by 28 (82.3%) programs. Integrated 
Management of Newborn and Childhood Illness was included in student evaluation by all programs (100%). All 
students and instructors (100%) rated that Integrated Management of Newborn and Childhood Illness concept is 
very relevant or extremely relevant but majority said the time given was short. The over all mean score of students 
clinical practice was 63.5% 

Conclusion: This study demonstrated that Integrated Management of Newborn and Childhood Illness was intro- 
duced into the teaching programs of most health professional training institutions. The most preferred teaching 
style was the mixed approach. Group discussion and demonstration were commonly used methods and Integrated 
Management of Newborn and Childhood Illness questions were included in students ' evaluation in almost all pro- 
grams. Shortage of IMNCI trained staff and teaching materials were major challenges. The use of teaching materi- 
als prepared for pre-service training like handbook and model chapter was limited. Instructors and students atti- 
tude towards IMNCI was very good. The students overall performance in managing sick child as per the IMNCI 
guidelines was above average. We recommend that the respective bodies at every level make every effort to 
strengthen IMNCI pre-service teaching through revisiting curricula, facilitating staff training, availing teaching 
materials and allocating adequate time. Exploring for an alternative/innovative and sustainable training approach 
is an assignment for all. 
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INTRODUCTION 

Estimates showed that 9.7 million in 2006 as com- 
pared to over 10 million in 1990 children were dying 
before they reach the age of 5 years (1). Over the 
past 10 years, declines in under-five mortality were 
observed globally but uneven with still highest rates 
of child mortality in Sub-Saharan African countries. 
In these countries, health conditions like pneumonia, 
diarrhea, malaria and measles, and neonatal causes 
are responsible for over 70% of all deaths in children 
under the age of 5 years (2). Shortage of trained 
health workers, scarcity of diagnostic supports and 
lack of drugs and equipment are among the chal- 
lenges for improving the survival of children under 
the age of five years. 

To address this, WHO and UNICEF designed 
the Integrated Management of Newborn and Child- 
hood Illness (IMNCI) strategy. The critical element 
of the IMNCI strategy is integrated case management 
of the most common childhood conditions, with a 
focus on the most common causes of death. Experi- 
ence shows that the training improves the case man- 
agement skills of a broad range of first level health 
professionals (3). However, in-service training for all 
relevant health workers requires resources and need 
major investment of the health system. In response to 
this challenge, pre-service IMCI training is consid- 
ered as a feasible solution to increase health system 
coverage by IMNCI trained health workers in a cost 
effective and sustainable manner and influence prac- 
tices of health professionals in both the public and 
private sectors. 

To support and facilitate the pre-service IMNCI 
training initiative, the Department of Child and Ado- 
lescent Health and Development (CAH) of WHO 
developed a process and materials for Pre-service 
IMCI teaching in medical and other health profes- 
sional schools in 1997. Many countries in different 
WHO regions have responded by introducing pre- 
service IMNCI in the training of nurses, midwives, 
health officers and medical doctors. 

In 2002 the preservice IMCI evaluation by 
WHO/ AFRO showed that 24 medical and paramedi- 
cal schools in 4 countries introduced Pre-service 
IMCI training by incorporating into their curricula 
(4, 5, 6). By 2005, 14 countries were implementing 
Pre-service IMCI training. Between May 2005 and 
June 2006, an evaluation of 19 training institutions in 
5 countries concluded that pre-service IMCI is well 
established and well accepted by teaching staff and 
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students (7). Of the several constraints mentioned, 
high attrition of trained staff, lack of commitment of 
health and academic authorities and the need for ad- 
aptation and updating of training materials to suit 
local situations were in the top. 

Ethiopia is among the first countries to imple- 
ment pre-service IMNCI training for health workers. 
It was first started in two higher learning institutions 
(Gondar and Jimma). At the time of the survey, most 
public and some private owned health professional's 
institutions were conducting pre-service IMNCI 
training. However, several concerns have been ex- 
pressed regarding the coverage, quality of training, 
follow-up after training, long-term impact and sus- 
tainability of pre-service training. Its effectiveness 
may also be limited by operational problems at coun- 
try and institutional levels. Therefore, the Ethiopian 
national IMNCI office supported by the World 
Health Organization, conducted a cross sectional 
survey on health professional training institutions to 
assess the status of pre-service IMNCI training. 



MATERIALS AND METHODS 



A descriptive cross-sectional survey was conducted 
on 32 health professional training institutions all over 
the country in November 4-25, 2007 but 3 were ex- 
cluded since they didn't start pre-service IMNCI 
training (Table 1). No sample size was determined, 
rather all public and some of the private institutions 
implementing IMNCI pre-service training were in- 
cluded in the survey. We used convenient sampling 
technique to select the private schools. Instructors 
and students who were available during the survey 
participated in the focus group interview (FGI) and 
performance evaluation for the latter. The study vari- 
ables were details of relevant characteristics of the 
schools; organization of teaching in pediatrics and 
child health; method(s) used to teach IMNCI; rela- 
tionship of IMNCI to core pediatric subjects; meth- 
ods used in monitoring progress and assessing stu- 
dents' performance; changes made to the curriculum 
and/or course outline; support facilities that were 
available and accessible to students and instructors; 
and the challenges of introducing and implementing 
IMNCI into teaching programs. 

The study instruments consisted of three sets of 
structured interview questionnaires, two sets of 
checklists each for observation of classroom and 
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clinical practice sessions and a student performance 
observation form. FGI instrument included structured 
questions with either alternatives or rating scale. The 
student performance observation form included key 
IMNCI tasks in assessment of sick children, classifi- 
cation of illnesses, identification of feeding prob- 
lems, identification and administration of treatment, 
and counseling of caretakers. Each task was rated on 
a scale of 0-3 (0 = not done, 1 = done but not cor- 
rectly, and 3 = done correctly) as judged by the ob- 
server. Total student score and total observer/ 
expected score were used to compute percent per- 
formance for each student. However, the checklists 
for observation of classrooms and clinical practice 
sessions was not used as there was no active IMNCI 
training going on in any of the institutions visited. 

The block method is teaching of IMNCI in block 
like in the in-service training model while the stag- 
gered approach is teaching of IMNCI case manage- 
ment theory and practice spread out over the whole 
duration of the pediatric course. On the other hand, 
the mixed approach is a combination of the staggered 
method plus short synthesis block of at least 3 days 
for consolidation placed either at the end or at the 
middle of the pediatric course. 

Three IMNCI experts, who were well versed with 
the IMNCI strategy visited the physical facilities of 
the selected health professional training institutions 
and administered interviews to heads and/or IMNCI 
coordinators, conducted FGI with teachers and stu- 
dents, observed students and graduates while manag- 
ing sick children using IMNCI guidelines, and re- 
viewed pediatric course outlines and other teaching/ 
learning materials. The three sets of interviews were 
conducted separately and independently to avoid the 
potential biases that mixing the groups might have 
caused. The principal investigator checked each data 
collector in the field at least once for appropriately 
conducting the interviews, group discussions and 
observations. 

The data were entered and analyzed using SPSS 
for windows version 12.0.1. Quasi-statistics method 
was used to analyze the qualitative (FGI) data. Fre- 
quencies and percentages were computed to see the 
pattern of study variables. 

The survey was conducted with permission and 
at the request of the Ministry of Health of Ethiopia. 
Permission was also obtained from participating in- 
stitutions. 



RESULTS 



Twenty nine health professional training institutions 
(22 public and 7 private) which has 34 academic 
programs participated in the study (Table 1). 

Of the 34 programs, 22 (64.7%) were diploma 
nursing, 6 (17.6%) B. Sc nursing, 4 (11.8%) health 
officer and the remaining 2 (5.9%) medicine. The 
duration of the trainings was 3 years for all except 
for medicine which was 6 years. The number of stu- 
dents in one batch ranged from 20-400 (mean 124) 
while the teaching staff in the department/school 
ranged from 2-52 with a mean of 15. Pediatrics 
course was given during the 2 nd and 3 rd years for the 
3 years' and 4 th year up to internship for the 6 years' 
programs. The total duration of pediatrics attachment 
ranged from 3-24 weeks for the 3 year and 35-41 
weeks for the 6 year program. The proportion of time 
dedicated for clinical practice ranged from 15-90% 
with mean of 50%. Lecture and practical teaching 
were used by all programs as the standard pediatrics 
teaching method (Table 2). 

Of the 29 institutions surveyed, institutional IM- 
NCI orientation was given in 18 (62.1%). Thirty 
(88.2%) of the programs have integrated IMNCI in 
their curriculum, their reasons being to address com- 
mon childhood problems 30 (100%), to equip stu- 
dents with better skills 28 (93.3%), to address deadly 
problems 26 (86.7%) and for its holistic approach 21 
(70.0%),. The main challenges encountered were 
availing training materials, shortage of tutors and 
problems in curricula integration were reported as 
main challenges by 30 (88.2%), 22 (64.7%) and 1 1 
(32.4%) programs, respectively. 

Though only 1 1 (32.4%) programs had IMNCI 
focal person, there was at least one department staff 
in 7 (20.6%), two or more in 27 (79.4%) programs 
responsible for IMNCI planning and management. 
All programs had at least one fulltime staff for IM- 
NCI classroom instruction (range 1-12). There were 
one or more staff trained in IMNCI case management 
and facilitation skills in 29 (85.3%) and 15 (44.1%) 
of the academic programs, respectively. Seventy-one 
percent of the programs had 2 or more staff trained in 
IMNCI case management skills. Only 12 (35.3%) 
institutions had IMNCI trained support staff at clini- 
cal sites. Curriculum integration and availability of 
teaching materials were mentioned as major achieve- 
ments by 25 (73.5%) programs. Thirty-one (91.2%) 
programs pointed out that more trained staff is their 
future need (Table 3). 
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Table 1. Background information of health professional training institutions and respondents involved in the 
survey, November 2007. 



Studied Institutions 


Number of 


Number of 


Number of 


Number of 




programs 


siuuenis 


instructors 


siuuenis 




Involved 


Involved in FG 


involved in FGI 


Observed 


Nekemt Health Science College (HSC) 


1 


9 


2 


0 


Mettu Health Science College 


1 


0 


2 


0 


Jimma University - Medicine 


3 


0 


0 


0 


- Health Officer program 




11 


0 


6 


- Nursing program 




0 


3 


0 


Unity University College § 


1 


0 


2 


0 


Alkan College of Health Sciences 5 


1 


0 


2 


0 


Addis Ababa University, Medical Faculty 


1 


0 


0 


0 


Central Medical College 5 


1 


0 


0 


0 


Menelik II Nursing School 


1 


0 


0 


0 


Kea-Med Medical College 5 


1 


0 


0 


0 


St. Luke Nursing College 5 


1 


5 


1 


0 


Haramaya University - Health Officer 


2 


0 


1 


0 


- Nursing 




0 


1 


0 


Harar Health Science College 


1 


0 


4 


0 


Asella Health Science College 


1 


9 


2 


1 


Onba T-tpallh 'spipnrp C^nllpw 


1 


5 


1 


2 


Shashemene College of Health Sciences 


1 


7 


1 


0 


Hawassa HSC - Hawassa Campus 


2 


5 


2 


2 


- Yirgalem Campus 




7 


1 


2 


Hawassa University, School of Nursing 


1 


0 


1 


0 


Arbaminch College of Health Sciences 


1 


0 


2 


0 




I 


n 


2 


o 


Dessie Mid-level Health professional Training 


1 


U 


1 


A 


Institute 










A/f ol.^cil 1 ci A^irl l/^/fM T-Tf^Qltn nrn+p eci nn n 1 Train 
1V1CK.C11C 1V11Q-1CVC1 ncdlLIl piUlCoMUIldT lld.111 - 


i 
i 


A 
u 


n 


A 
U 


ing Institute 










oneDa college oi rieaiin sciences 


i 
i 


u 


9 


A 
U 


Hpnnann fimpinpr ^plinnl nf T*JnrQintr^ 




5 


o 


o 


A^pI^pIIp T Inii7Preihf T-Tpnltn Mrh/'Are nrnrirain 

ivicKciic umvciMiy, ncaiLii wiiiccia piogiaiii 


i 

i 


j 


n 

u 


7 
z. 


Axum Mid-level Health professional Training 


1 


0 


0 


0 


Institute 










Gondar University - HO program 


2 


3 


4 


0 


- Nursing program 




0 


2 


0 


Tedda Mid4evel Health professional Training 


1 


0 


0 


0 


Institute 










Debretabor College of Health Sciences 


1 


0 


3 


0 


Bahirdar University, College of Health Sci- 


1 


0 


0 


0 


ences 










Total 


34 


71 


42 


15 



Evaluation of pre-Service Training on. 



Abraham HA et al 



Table 2. Profile of academic programs and general pediatric teaching, November 2007. 



dLILI 13111.3 


11 U111UL I 


X CI tClll 


Academic program (n= 34) 






Medicine 


1 

Z 




■ i .... i * i. .. ft". ...... 

Health otiicer 


A 

4 


11.8 


Nursing B. Sc 


0 


17.0 


Nursing diploma 


22 


64.7 


Duration of training 






3 years 


32 


94.1 


6 years 


i 

z 


5 0 


Number students in one batch (Range— 20-400, 






iviean— iZ4) 






<50 


3 


8.8 


50-100 


9 


26.5 


1 nn 1 zn 


1Z 


1Z 1 

JJ.J 


1 3U-ZUU 


0 


17 f\ 


>200 


4 


11.8 


Number of teaching staff in the department/ 






school 






5 or less 


5 


14.7 


5-10 


7 


20.6 


>10 


22 


64.7 


Time of pediatric teaching 






2 - 3 year 


32 


1 

V4.1 


4 th year-Internship 


2 


5.9 


Duration of pediatrics attachment 






< 4 weeks 


5 


14.7 


4-8 weeks 


2 


5.9 


8-12 weeks 




.38.2 


> 12 weeks 


14 


41.2 


Pediatrics teaching method 






Lecture 


34 


100.0 


Tutorial 


18 


52.9 


Seminar 


23 


67.6 


Problem solving 


16 


47.1 


Practical 


34 


100.0 


Proportion of time dedicated to clinical practice 






< 30% 


5 


14.7 


30-50% 


15 


44.1 


> 50% 


14 


41.2 
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Table 3. Human resource development and IMNCI training, November 2007. 



Characteristics 


Number 


Percent 


Number of department staff responsible for planning and management of 






IMNCI (n=34) 






One 


7 


20.6 


Two or more 


27 


79.4 


IMNCI Focal person (n=34) 






Present 


11 


32.4 


Absent 

' » .7 V. MM 1 


23 


67.6 


IVnmhcr nf fnlltiinc TIYTIVC 1 ! classroom instructors 

1 ' U111UV1 UI 1 UI1 i- 1 1.11 V, 11T11 ~ V 1 V. 1 tl .T 1 VJ VJ 111 1 1 1 > 7 I 1 II v 1 Vr 1 .7 






One 


5 


14.7 


Two or more 


29 


85.3 


Nnmher of fiilltimc TMNCT clinical instructors 

i. 1 UlllUVl v" 1 1 Ull 11.111V.- 1 . T ■ . i V 1 V- 1 1 1 1 1 V- t-l 1 111111 UV IU1 .t 






One 


6 


17.6 


Two or more 


4 


11.8 




24 


70.6 


Nnmhcr nf staff trained in T1YT1VCT f^asc management course 

. l 11 1 1 1 1.1 V 1 19 ■ iTlitll 11 aillV. U 111 IHII^ VI VllJl. lllitll(l{ivlllvlll .TV. 






None 


5 


14.7 


One 


4 


11.8 


Two or more 

■ f ¥ ' f Ul 11IU1 V. 


25 


73.5 


Number of staff trained in IMNCI Facilitation skills course 






None 


19 


55.9 


One 


3 


8.8 


Two or more 


12 


35.3 


T1VTNCT trained snnnort staff at nractical site (n=34^ 






Present 


12 


35.3 


Ahsent 


22 


64.7 


Major achievements 






fiivincr case management course for staff 


14 


41.1 


f^ivin** facilitation skill course for staff 

VJ1»111J; I ilvllllallllll 31V111 LUUl .31 1U1 31M11 


14 


41.1 


Curriculum integration 


25 


73.5 


Securing training materials 


25 


73.5 


Major challenges experienced 






Lack of trained staff 


9 


26.5 


Shortage of teaching aids 


7 


20.6 


Staff turn over 


5 


14.7 


Lack of concern/support for IMNCI teaching 


3 


8.8 


Future needs 






More trained staff 


31 


91.2 


More training materials 


8 


23.5 


More training facilities 


4 


11.8 
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The entire 34 academic programs taught IMNCI 
through mixed 28 (82.3%), staggered 4 (11.8%) and 
block 2 (5.9%) teaching approaches. Twenty-seven 
(79.4%) of the programs taught classroom and 26 
(76.5%) clinical IMNCI teaching during the 3 rd year 
of their training. IMNCI contents were covered in 
lectures of related pediatric topics by 28 (82.3%) 
programs. The most often used methods for class- 
room teaching were group discussion, demonstration 
and lectures by 28 (82.4%), 19 (60%) and 14 
(41.2%) programs respectively. Fifteen (44.1%) pro- 
grams reported that individual feedback was the least 
often used teaching method in the classroom. Lack of 
appropriate teaching materials was cited as the main 
challenge by 25 (73.5%) programs. 

The most common teaching methods used for 
clinical IMNCI instruction were; demonstration, su- 
pervised individual clinical practice and group prac- 
tice by 28 (82.4%), 27 (79.4%) and 25 (73.5%), re- 
spectively. Most programs used both outpatient and 
inpatient facilities for clinical IMNCI practice and 28 
(82.4%) confirmed that their students managed out- 
patient and inpatient cases. Each student saw variety 
of signs including children with severe illnesses in 28 
(82.5%) and 26 (76.5%) programs, respectively. 
Every student managed at least 20 children and re- 
ceived feedback on his/her performance in 12 
(35.3%) and 26 (76.5%) programs, respectively 
(Table 4). 

The instructor to student ratio for classroom session 
ranged from 1:3 for Goba to 1:120 for Hossaena 
Health Sciences Colleges with a mean of 1:48. IM- 
NCI chart booklet was the most frequently used ma- 
terial for classroom training by instructors in 30 
(88.2%) and by students in 29 (85.3%) and also for 
clinical practice by instructors in 26 (76.5%) and by 
students in 22 (64.7%) programs. 

IMNCI in student assessment: Thirty-three 
(97.0%) of the academic programs have included 
IMNCI in the regular assessment of students during 
classroom and clinical practice sessions. IMNCI 
questions were included in written exams in all the 
34 (100%) and practical exams in 19 (56%) pro- 
grams. IMNCI knowledge and skills were evaluated 
by 33 (97.0%) and 23 (67.6%) academic programs, 
respectively. Each student was observed while man- 
aging at least one sick child by 19 (56.0%) programs 
(Table 5). 



Students' focus group interview: Seventy three 
students from 1 1 programs (3 health officer and 8 
diploma nursing) participated in the focus group in- 
terview with the smallest group being three and the 
largest eleven. Majority of the group, 10 (91.9%) 
acknowledged as introduction, assess & classify, 
identify treatment, treat, follow-up and counsel the 
mother were covered. All (100%) rated IMNCI con- 
cept as very relevant but majority said the time given 
was short. Six groups (54.5%) indicated that the time 
of introduction of IMNCI in their training program 
was fully appropriate. Demonstration was cited as 
the most useful and frequently used teaching method. 
Nine (81.8%) groups reported that chart booklet was 
the most useful learning material. All groups con- 
firmed that IMNCI was included in their exams. Ma- 
jority 10 (90.9%) said that they are confident to man- 
age sick children using IMNCI guidelines (Table 6). 

Instructors' focus group interview: Forty two in- 
structors from 22 academic programs (2 health offi- 
cer, 6 B. Sc nursing and 8 diploma nursing) partici- 
pated in the focus group interview with the largest 
group being four. Thirty-eight (90.8%) of the partici- 
pants were trained in IMNCI case management. All 
(100%) rated that IMNCI concept was relevant/very 
relevant since it addresses common problems. How- 
ever, majority commented that the time given to both 
classroom and clinical sessions was inadequate. Thir- 
teen groups (59.1%) agreed as the time of introduc- 
tion of IMNCI in their training program was fully 
appropriate. Demonstration was recognized as main 
teaching method used for classroom [12 (54.5%)] 
and clinical teaching [11 (50.0%)] teaching. Fifteen 
(68.2%) groups said that chart booklet was the most 
useful learning material. Twenty (90.9) confirmed 
that they are confident/very confident as their stu- 
dents could manage sick children using IMNCI 
guidelines but 2 (9.1%) doubted (Table 7). 

Observation of student performance: Fifteen stu- 
dents from 6 academic programs were observed 
while they manage sick children as per IMNCI 
guidelines. Eight of the students were from health 
officer program and the remaining 7 from diploma 
nursing. Students' mean score was 70.2%, 69.3%, 
50.0%, 42.0% and 64.0% for assess, classify, identify 
feeding problem, identify treatment and counsel sec- 
tions, respectively with over all mean score of 63.5% 
and median of 67.7 (Fig 1). 
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Table 4. Experiences in classroom and clinical IMNCI training and challenges faced, November 2007 . 



Chsrscteristics 


Number 


Percent 


IMNCI concept taught within related subjects (n = 34) 






Yes 


28 


82.4 


No 


6 


17.6 


Arvnrnjirli/YnpthoH hspH ^n=^4^ 






Block 


2 


5.9 


Staggered 


4 


118 




28 


82.3 


Placement of classroom IMNCI teaching (n = 34) 






2 nd year 


5 


14.7 


3 rd year 


97 


70 A 
/ 7.4 


5 th year 


2 


5 9 


Time allotted lor classroom IMNCI (n=34) 






< 40 hours 


1 c 

1 J 


A A 1 
44. 1 


> 40 hours 


19 


58.9 


The most often used teaching methods in classroom IMNCI 






Group discussion 


Z© 


oZ.4 


D emo n strati o n 


1 O 




T p^r'ti i Vi^ 

IjCLLUIC 


14 


41 2 


Placement of clinical IMNCI teaching (n=34) 






No clinical session 


i 
j 


8 8 


2 nd year 


i. 

j 


8 8 


V' d vpar 


zo 


76 5 


5 th year 


2 




i line diioLLeu 101 ciiiiicai iivn>^i ^n j'-x) 






< 40 hours 


1 A 
14 


/111 
4 1 .Z 


> 40 hours 


1 J 


jo.Z 


Not mentioned 


7 


20.6 


The most often used teaching methods in clinical IMNCI (n=34) 






Demonstration 


28 


82.4 


supervised individual student practice 


27 


79.4 


Group practice 


25 


73.5 


Sites of IMNCI clinical practice (n=34) 






Inpatient 


25 


73.5 


Outpatient 


29 


85.3 


Field assignment 


18 


52.9 


Each student managed both outpatient and inpatient cases (n=34) 






Yes 


28 


82.4 


No 


2 


5.9 


Not sure 


4 


1 1.8 


During IMNCI clinical practice, each student saw variety or signs (n— 34) 






i es 


Zo 


OZ.J 


XT ~ 

IN O 


Z 


^ Q 

J.y 


Not sure 


4 


11.8 


Each student saw children with severe illnesses (n=34) 






Yes 


26 


76.5 


No 


3 


8.8 


Not sure 


5 


14.7 


Each student managed at least 20 sick children (n=34) 






Yes 


12 


35.3 


No 


11 


32.4 


Not sure 


11 


32.4 


Each student received feedback on his/her performance (n=34) 






Yes 


26 


76.5 


No 


2 


5.9 


Not sure 


6 


17.6 
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Table 5. Inclusion of IMNCI concept in informal and formal students' assessment, November 2007. 



Characteristics 


Number 


Percent 


Regular checking during IMNCI classroom and clinical instruction 






i es 


ii 




INO 


t 
i 


i n 
i.D 


i ecnniques usea to cnecK stuuenis progress ^n— jj) 






Question and answer 


28 


84.8 


Group feedback/discussion 


19 


57.6 


Case report 


Q 

o 


1A 1 

14.1 


Individual feedback 


A 

4 


tit 
12.1 


Case study 


1 


3.0 


IMNCI questions or problems included in (n=34) 






Written exam 


33 


V7.U 


Practical exams 


t 1\ 
ly 


55.y 


Written projects or reports 


18 


52.9 


Oral exams 


7 


20.6 


Formal evaluation of individual student s IMNCI Knowledge (n— 34) 






Yes 


ii 
ii 


y/.u 


No 


1 


3.0 


Ways of IMNCI knowledge evaluation (n=33) 






Written exam 


21 


81.8 


Oral exam 


£ 


13.1 


/ ' i * .... i < i * . 
Check list 


2 


6.0 


Formal evaluation of individual student's IMNCI Skill (n=34) 






Yes 


ii 

Li 


07.0 


INO 


n 

1 


in a 
zu.o 


Not sure 


A 

4 


1 1 o 

11.8 


Ways of IMNCI skill evaluation (n=23) 






Practical exam 


18 


78.3 


Case study 


6 


26.1 


Check list 


4 


17.4 


Observation and feedback 


2 


8.7 


Each student is observed and evaluated as he/she manages at least 






one sick child using IMNCI guidelines (n=34) 






Yes 


19 


56.0 


No 


10 


29.0 


Not sure 


5 


15.0 
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Table 6. Students' focus group interview (n=ll groups), November 2007. 



Characteristics 


Number 


Percent 


Relevance of IMNCI concept 






Not relevant / Relevant 


0 


0 


\/Ar\7 t-cil pirn n f 

vtiy iCicvdiiL 


7 




1 -/\ Ll wlllwl V Iblv VClllL 


4 


36.4 


1 1I11C dllOLLCU 1UI L-ltlaalUUlll JlVllMv^l ^lall^C lU-Ut 






ioo snort ju nrj 


7 


Oj.O 


Adequate (> 62 hr) 


4 


36.4 


Too long 


0 


0 


— — : — — — : — 

lime allotted lor clinical IMNCI (range=10-224 hours) 






Too short (< 1 12 hrs) 


8 


72.7 


Adequate (>1 12 hrs) 


3 


27.3 


Too long 


0 


0 


Time of IMNCI introduction in the academic program 






Not at all appropriate 


3 


27.3 


Neutral 


2 


18.2 


Fully appropriate 


6 


54.5 


Most Irequently used methods 






Demonstration 


8 


72.7 


Group discussion 


3 


27.3 


Most useful methods 






Demonstration 


9 


81.8 


Video 


2 


18.2 


Opportunities for clinical practice using IMNCI 






Individually 


6 


54.5 


In groups 


2 


18.2 


Both 


3 


27.3 


— — — ; — — 

Number ol patients managed by each students 








-i 
j 


97 % 




0 


S4 S 


>20 


2 


18.2 


Materials used by students to learn about IMNCI 






Chart booklet 


9 


81.8 


Modules 


7 


63.6 


Video 


1 


9.1 


Most useful learning materials 






Chart booklet 


9 


81.8 


Video 


2 


18.2 


Inclusion of IMNCI in the formal examination 






Yes 


11 


100.0 


No 


0 


0 


What kind of formal examination was it? 






Written 


8 


72.7 


Practical 


3 


27.3 


Examinations accurately measured knowledge and skills in IMNCI 






Yes 


8 


72.7 


No 


3 


27.3 


Confidence of students in using IMNCI to manage sick children 






Not confident 


0 


0 


Somewhat confident 


1 


9.1 


Confident 


3 


27.3 


Very confident 


6 


54.5 


Extremely confident 


1 


9.1 
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Table 7. Instructors focus group interview (n=22 groups), November 2007. 



Characteristics 


Number 


Percent 


Relevance of IMNCI concept (n=22) 






Not relevant 


0 


0 


Relevant 


3 


13.0 


Very relevant 


1 t 
12 


C A C 

54.5 


Extremely relevant 


7 


1 1 Q 


Reason why IMNCI is relevant 






/\uuresses common prooieiii 


Q 

y 




SlimnlifipH HnH nrvnlipjihlp 


3 


13.6 


Holistic* annroacb 


3 


13.6 


l-fpln Qtiinpnt*; to upmurp cVill 

1 ILlli olUUtlllo l\J tlLL LlllL. oJvlll 


3 


13.6 


i line diioueu lur cidssroom iiviinv^i naming yi-oz. nours^ \ii — zzj 






Tn n H pm i n tp 

1 J 1C! Vj LIC! l\_ 


12 


54.5 


A H pnii £ii"P 
jrV(JCC[Ua I C 


1 ft 


45 5 


i line diioueu lur cuiiicdi iiviinv>i naming ^i-o/zj nours^ — iu) 






Inadequate 


1 n 

1U 


OZ.J 


A Hpnuotp 

/\uec[Uaie 


o 


J / .J 


Time oi IMNCI introduction in the academic program (n=22) 






Not at all appropriate 


4 


18.2 


Neutral 


5 


22. / 


Fully appropriate 


i j 


1 

Jy. 1 


Most frequently used methods 






Demonstration 


8 


36.4 


uroup discussion 


0 


TT 7 

2 /.3 


Lecture 


r 
0 


77 7 

z /.3 


Video 


A 

4 


1 O 7 
15. Z 


Most useful methods 






Demonstration 


14 


63.6 


Individual feedback 


O 

0 


3o. 4 


Any suggestions for improving teaching methodology 






Avail teaching materials 


6 


27.3 


Allocate more time for practice 


5 


zz. / 


oidii naming 


Q 

y 




What materials students used to learn about IMNCI.' 






Chart booklet 


1 c 

15 


/TOT 

05. Z 


Video 


8 


36.4 


Modules 


0 


77 "5 

2 1 .5 


Photo booklet 


7 

L 


Q 1 


Do you check how well students were learning / 






Yes 


20 


90.9 


No 


t 

2 


9. 1 


Ways of checking (n=20) 






Exam 


9 


45.0 


Individual feedback 


7 


35.0 


Question and answer 


3 


15.0 


Group feedback 


2 


10.0 


Confidence of students in using IMNCI to manage sick children 






Not confident 


2 


9.1 


Confident 


6 


27.3 


Very confident 


12 


54.5 


Extremely confident 


2 


9.1 
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Figure 1. Students' performance mean score for basic IMNCI skills, November 2007. 



DISCUSSION 



General Background information: In general this 
survey was a success since it involved most of the 
health professionals' training institutions in the coun- 
try. To the best knowledge of the authors, this study 
is the first of its kind in the country. However, as the 
time of the survey was at the beginning of the aca- 
demic year, classroom and clinical IMNCI teaching 
were not observed, few groups of students partici- 
pated in FGI and also students from few programs 
were observed while they manage sick children as 
per the IMNCI guidelines. 

Preparation and Planning for IMNCI Teaching: 

This survey showed that most of the surveyed health 
professionals' training institutions underwent IMNCI 
orientation (62%) and curriculum integration (88%) 
demonstrating the fact that how well the pre-service 
IMNCI training was planned and done systematically 



in Ethiopia. Similarly, the WHO review of pre- 
service IMNCI experience showed that most of the 
countries that started pre-service IMNCI have con- 
ducted orientation (94%) and included IMCI into 
the curriculum (83%) of medical and paramedical 
schools (8). 

Though most of the surveyed health professional 
training institutions had adequate number of pediat- 
rics teaching staff, the IMNCI teaching staff was 
limited similar to the above mentioned WHO study. 
Though the standard instructor to student ratio of 
the in-service training is not expected in the pr- 
service setting, the actual instructor to student ratio 
in this survey was very low. This survey has also 
shown that 14.7% of the academic programs did not 
have trained staff while 1 1.8% of them had only one 
IMNCI trained staff. As these may have impact on 
the continuity and quality of the pre-service IMNCI 
teaching, staff training should be facilitated. 
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IMNCI teaching and Student Evaluation: The 

overall impression of IMNCI teaching was positive. 
All components of IMNCI with emphasis of health 
worker skills were taught and IMNCI didn't replace 
the previous pediatric teaching, rather either incorpo- 
rated or added. A mixed approach was used by the 
majority to teach IMNCI in line with the WHO re- 
port (8). 

The time allotted for general pediatrics teaching 
and IMNCI in particular was short for most pro- 
grams. Though most of the academic programs 
taught both IMNCI theory and clinical practice, the 
time for practical session was short. Three programs 
(8.8%) taught only theory without clinical practice 
and so students didn't have chance to see signs and 
to classify and treat sick children. As omitting the 
practical session could affect the skill of graduates, 
those programs that are teaching theory alone should 
be encouraged to incorporate practical session too. It 
has been shown that group discussion/feedback and 
demonstration were the commonly used and useful 
teaching methods which were acceptable for large 
class size while individual feedback the least used. 
The fact that IMNCI was included in formal (written 
and practical) and informal knowledge and skill 
evaluation of students could stimulate them to allot 
study time to IMNCI which is in line with the WHO 
survey report (8). As shortage of trained staff was 
one of the main challenges in most of the academic 
programs affecting the planning, training and student 
evaluation, it needs to be addressed systematically. 

Instructors and students attitude (Focus group 
interview): The overall interviewed instructors and 
students' impression of IMNCI teaching was very 
positive. Teaching staff involved in IMCI teaching 
were very positive about the IMCI action-orientated 
approach to outpatient teaching and rated its rele- 
vance as high. Demonstration and group discussion 
were found to be the commonly used and important 
teaching methods and chart booklet was the most 
important teaching material. Twenty of the groups 
were at least confident that their students could man- 
age sick child using IMNCI guidelines. 

In most schools/departments, students were en- 
thusiastic about IMNCI rating high in its relevance 
but they complained on the shortage of allotted time 
and teaching materials/ aids. They all felt at least 
confident about their capacity to manage sick chil- 
dren using IMNCI guidelines in future. They enjoyed 
the variability of the teaching methods employed in 
the IMCI-related sessions, the approach moving from 
theory to clinical practice and the materials available. 
Finally, they suggested that more time should be 



allocated to IMNCI in the teaching program to mas- 
ter all tasks. 

These findings are encouraging for teaching 
institutions and health bureaus to systematically 
strengthen the IMNCI pre-service teaching. 
Teaching materials: Similar with the WHO survey 
report (8), the findings of this survey showed that 
most students and instructors were using the national 
IMNCI materials developed for in-service training 
rather than the IMNCI model chapter and handbook. 
The IMCI chart booklet, containing the technical 
guidelines, was either kept in libraries or distributed 
free-of-charge to students after duplicating them. 
Almost all used and emphasized the importance of 
the chart booklet. But all have complained on short- 
age of teaching materials and aids. So, ensuring 
availability of these materials to students in the long 
term was identified as a major issue. In the WHO 
multi-country survey, sustainability of training mate- 
rials was among the most frequently mentioned chal- 
lenges and there was a concern that it could affect the 
quality of the trainings (8). 

Observation of Students Practical performance: 

Students assessed and classified sick children well 
but they had some difficulties in identifying feeding 
problems, identifying treatments needed and counsel- 
ing the mother. This may be the reflection of the poor 
clinical practice by some of the academic programs 
especially the focus given for counseling skills. 
Overall, children were correctly classified according 
to the IMNCI guidelines in most cases. 

In conclusion, this study showed that IMNCI 
orientation was given in majority of training institu- 
tions, introduced into the teaching programs of some 
medical and most paramedical teaching institutions 
and incorporated in the curricula of most of the 
teaching institutions. Mixed approach was the pre- 
ferred approach by the majority of the programs. 
Group discussion and demonstration were the most 
commonly used teaching methods and student 
evaluation included IMNCI concept in almost all 
programs (33/34) but some programs allotted short 
time for clinical practice. Shortage of IMNCI trained 
staff and teaching materials were major challenges to 
most institutions as a result the IMNCI instructor to 
student ratio was very low for most of the schools. 
The use of teaching materials prepared for pre- 
service training like the IMNCI hand book and 
model chapter were limited and the overall instruc- 
tors' and students' attitudes towards IMNCI was very 
good. Though the students' performance in identify- 
ing feeding problems and treatment was low, their 
overall performance on managing sick child as per 
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the IMNCI guidelines was above average. The main 
challenges for pre-service IMNCI training were; staff 
attrition, shortage of teaching materials, difficulty of 
integrating IMNCI in existing curriculum and shortage 
time, and large number of students. 

We recommend that the responsible authorities at 
every level make every effort to strengthen IMNCI pre- 
service training through revisiting their pediatric/IMNCI 
curriculum, facilitating staff training, and availing ap- 
propriate teaching materials and aids. It is also advised 
to strengthen clinical IMNCI teaching by allocating ade- 
quate time and improving the organization of training 
sites. Experts should explore for alternative/innovative 
approaches for pre-service IMNCI training and sustain- 
able availability of teaching materials. 
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